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(54) IMPROVEMENTS IN OR RELATING TO 
DETECTION APPARATUS 

Tnki^L. Z% mTACHI LIMITED of 1-5-1 Marunouchi, Chiyoda-ku, 
£w ffi ' 3 ^ dy f borate organized according to the. laws of Japan, do hereby 
£ m,t£$ k - 0I - WlU< ? W£ pray a ma y be granted to us, and 

u^J^i^V^ 7 ^ 0 ? relatcs t0 apparatus for detecting small portions of a 
fe patt ^ / Pa^^ar application of the invention is for the detection and 
S?5 of ° r ba . d ?P°* *» a pattern, and much of the followtg descrTp. 

torn drals with this, but it is to be understood that the invention is not so 3d 
10 and references hereinafter to defects or bad spots should be read to mctadelS 
pattern portions in general, where the context permits. 

h,™ 1 K rcVI0USly ' P^ 18 paving complex patterns such as printed circuits or IC pellets 
£f,J^ n 5n e T mCd V ; SUBlly by ^ bspectors > b^ since defective arei are 3 
^yl! d m ? e compIex Patt^ of these devices and are very small in sSe t£ 
15 may pass undetected very often, and a lengthy inspection is required, even bvTskulS 
inspector. Furthermore eye fatigue is considerably increased when S Infection 

SSki * J b - een devi f d and demonstrated an automated inspection equipment 
capable of detectag the defects included in a simple pattern in a S bSoTd 

nS^ y I Pted f ° r d f te ? Uns bad ^ 01 micro-defects included in a coraotex 
pattern such as a printed circuit or IC pellets has been proposed ye? P 

,w nnf ? i 8 4 been P5°P° sed m kspection method in which a reference image which 
«ww ^ bght whereas 1116 part 10 be inspected is illuminated with ereen hSt 

of a pan to be inspected must be made with an exneraelv hiah StSrfXLSS 

m^ M m ^ ma ,L b ^rr r v -sftiSi^eK 

^ 0etween ^ Wo "^P*. the misaligned portions become green or red 
\Price33p] 
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so that they arc mistakenly taken to be defects. Therefore this method is not entirely 
suitable for automated inspection equipment. 

According to the present invention there is provided apparatus for detecting and 
extracting portions in a pattern including: input means for sequentially scanning a 

5 pattern to be inspected and converting said pattern into an electrical video signal; 5 
means for sampling said video signal at predetermined sampling time intervals cor* 
responding to picture elements of said pattern to be inspected and converting said video 
signal into binary form; a two-dimension image extracting means for rearranging the 
one-dimensionally arranged output from said sampling and binary converting means into 

10 a two-dimensionally arranged signal representing a sub area of the pattern; and small 10 
portion processing means for extracting a signal from the information stored in said 
two-dimensional image extracting means, thereby extracting a small portion from 
said pattern. 

The invention will be more particularly described by way of example with 
15 reference to the accompanying drawings, wherein: — 15 
Figure 1 is a block diagram of an apparatus in accordance with the present 
invention; 

Figures 2, 3 and 4 show the dark and bright patterns to be inspected by the 
apparatus of Figure 1; 

20 Figure 5 is a block diagram of an apparatus incorporating a floating threshold 20 

type analogue-to-digital converter; 

Figure 6 shows one example of the image of a pattern to be inspected; 
Figure 7 is a block diagram of an apparatus similar to that shown in Figure 1 
but including a two-dimensional image extracting device; 
25 Figure 8 is a block diagram of an apparatus similar to that shown in Figure 7 25 

but with a modification of the two-dimensional image extracting device; 

Figure 9 is a block diagram of an apparatus similar to that shown in Figure 7 
but with another modification of the two-dimensional image extracting device; 

Figure 10 is a detailed view of a component of the apparatus shown in Figure 9; 
30 Figure 11 is a view used for explanation of the apparatus shown in Figure 9; 30 

Figures 12 to 15 are views used for explanation of the use of the boundary 
spacing method in the present invention; 

Figure 16 is a detailed block diagram of the apparatus of Figure 1; 
Figure 17 is a diagram of a micro-spot extracting circuit based upon the bound- 
35 ary spacing method; 35 
Figure 18 shows the logic patterns used for the explanation of the boundary 
spacing method; 

Figure 19 is a diagram of the boundary extracting circuit shown in Figure 16; 
Figure 20 shows the logic patterns used for the boundary extraction method; 
40 Figure 21 illustrates one example of a comparator used in the apparatus shown 40 

in Figure 16; 

Figure 22 to 27 are views used for the explanation of the use of the enlargement- 
reduction method; 

Figure 28 is a block diagram of an apparatus similar to that shown in Figure 
45 1 except that a small portion processing device based upon the enlargement-reduction 45 
method is incorporated therein; 

Figure 29 is a diagram of a small portion extracting circuit based upon the 
enlargement-reduction method; 

Figure 30 is a perspective view of an optical processing device based upon the 
50 enlargement-reduction method to assist in the understanding of the invention; 50 
Figures 31 to 35 are views used for the explanation of the use of the boundary 
averaging method in the present invention; 

Figure 36 is a view used for the explanation of the bad spot extracting method; 
Figure 37 is a block diagram of an apparatus similar to that shown in Figure 1 
55 except that a micro-spot processing device employing the bad spot extracting method is 55 
incorporated therein; 

Figure 38 shows the logic patterns used for the explanation of the bad spot 
extracting method; and 

Figure 39 is a diagram of a micro-spot extracting device based upon the bad 
60 spot extracting method. 60 
First there will be some explanation of some underlying principles of the 
present invention. The inspection equipment to be described is intended to inspect a 
multi-dimensional pattern consisting of two conditions, ON and OFF or light and 
dark, which are referred to as "binary states" in this specification. Therefore, the 
65 'patterns may be a one-dimensional pattern such as telegraph codes, a two-dimensional 65 



10 



15 



20 



25 



30 



1,417,721 

CS2%Z H consisting of white - d black a *~ 

. J5f- ^ ^T" 8 descri P tion °f embodiment exemplifying the present invention 
not lmuted Jereto and on use any one- or multi-dimensional pattern 
n«n^ u^^^ P*^™ is for exam P*e a Hack character or the like 

a^aSrn tevin^ f * ^ UntkrSt « )d * « «t£& to suck 

a pattern having a binary character in the strictest sense of the word FoTtxamdl 

^e In raSe -° f 3 ^^ensional multi-level pattern in which the tone is varied in 
H s a °f co ^ uo ^y » order to provide the contrast, Ae pattern nS?^ k <Srted 
^o-d^ensional pattern by a suitable threshold P roc«sm?mScL 

the S tt R &' ,D FlgUre 1 mustratin S 8 npS TSrim with 

^Th e ^,?^ mg ^ 14 is . a PP Ued to a 3111311 Portion P^cSg devL 16 
«f P" 3 ? 1011 processm g ™* W may be an electronic computer, but instead 

a™iish STE* S° mPUter desigDed hardware <** »*3 adaptt fS 

f™£ h n CO a boundary space process, ii) an enlargement-reduction proceS fiS 35 
a penpheryaveragmg process, and (iv) a small portion extracting proSfaU^ 
which will be described in detail hereinafter, but it will heSSJJ RE? to Tnre- 
S^ 011 - 18 DOt ^ t0 ^ ^ four metfa ods. An dwicfor ? cotour 
40 proSsso^ 18 C "* W 35 » 0UtpUt ^ de ^ to « outp^ Silin 0 of 

In extracting the small portion of a multi-dimensional pattern there mav he ™ 

The devices shown in Figure 1 wiU be described in more detail hereinafter. 50 
Quantizing unit (AD Converter) 
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example chrominum deposited upon a transparent glass plate. Bad spots in the dark 
area are indicated at 18 and 19, and in the bright area at 20 and 21. The video sig- 
nal 23 is derived along the scanning line 22 passing through these bad spots, the 
voltage/time trace of ±e signal being shown below the part pattern. The spots appear 

5 in the video signal at 18', 19', 20' and 21' respectively. A threshold level 24 is fixed 

at a midpoint between the white and black levels. When the spots 19 and 21 are too 
small compared with the diameter of the electron beam, the levels of the signals 19' 
and 21' do not reach the threshold level 24. Therefore the binary signals 25 as shown 
in Figure 3 are produced and it is seen that the spot 19 and 21 in Figure 2 are not 

10 detected at all. 

In the floating threshold method, the threshold level is varied depending upon 
the dark and bright levels .of an image so that the bad spots 19 and 20 which are 
extremely small in size may be detected. For example as shown in Figure 2, a 
threshold level 26 is lowered when the level of the video signal level is low, but is 

15 raised when tie latter is high. The centre or mean level of the floating threshold 
level 26 coincides with the fixed threshold level 24 and is slightly smaller than the 
level of the video signal 23. The signal representing a bad spot goes to the opposite 
direction of polarity to that of the signal representing the background provided the 
floating threshold level is varied sufficiently slowly with respect to the reversal in 

20 polarity of the video signal 23. Thus the. binary signals 27 as shown in Figure 4 
may be derived. It is seen that the video output signal is very fast to respond the 
reversal in brightness of the image at the bad spots and the boundary between the 
dark and bright areas. It is preferable that the level of the floating threshold 26 is 
as high as possible so far as it will not reach the noise levels in both the bright and 

25 dark levels. The floating threshold level is formed from the video signal. If the res- 

ponse time is too long, the signal representing a bad spot will not coincide with the 
actual spo^ but if the response time is too short the resolution power is reduced. 
Therefore there must be a compromise between the response rate and the resolution 
power depending upon the image and hence a part to be inspected. 

30 Figure 5 is a block diagram of an inspection equipment similar to that shown 

in Figure 1 and provided with the floating threshold type binary converter as described. 
The object 11 such as a printed circuit or an IC mask is scanned by the TV camera 
12. A stationary threshold generator 28 gives a fixed threshold level depending upon 
the bright and dark levels of an image. A subtracter 29 subtracts the output signal of 

35 the generator 28. from the output signal of the TV camera 12 so that the centre 
level of the threshold level may be maintained almost at 0. The output 35 of the 
subtractor 29 enters a circuit 30 whose gain is slightly smaller than unity and which 
slowly trails the input signal. In practice the circuit 29 and 30 are operational ampli- 
fiers one of which is a linear delay line having a resistor and a capacitor inserted in 

40 the feedback loop and the other of which is an inverter with a gain less than unity 
for inverting the polarity. An adder 31 is adapted to add the output signal 36 from 
the circuit 30 to the output signal from the stationary threshold generator 28 so that 
the average level of the signal 36 may coincide with that of the video signal 33. The 
output signal 37 of the adder 31 is the floating threshold level 26 (Figure 2). A 

45 comparator 32 compares this signal with that from the TV camera 12 and gives "1" 
or "0" depending upon the difference therebetween. Thus, the output signal 38 of 
the comparator 32 corresponds to the signal 27 shown in Figure 4, that is the binary 
signal. 

In the fixed threshold level generator 28 a constant voltage from a constant volt- 
50 age source may be divided by a variable res.'stor, and the other circuits 29, 30, 31 
and 32 may comprise simple operational amplifiers. 

In this description the photo-electric converter 12 has been referred to as a TV 
camera for scanning the part 11 to be inspected so that the video signals are sequen- 
tially derived but the floating threshold level system may be also applied to a sys- 
55 tem in which a two-dimensional information is simultaneously processed by using 
a photo-electric converter 12 of the type capable of storing the focussed image such 
as an array of photo-electric cells and a memory of the type capable of storing an 
image which has uniform brightness over the whole area thereof and whose centre 
level, that is the spatial average, is fixed. The memory may be for example an array 
60 type frame memory. Instead of the subtractor 29, for example an array type opera- 
tional amplifier group may be used for shifting tire brightness of an image by sub- 
tracting the average brightness thereof. The circuit 30 is a filtering device such as a 
low-pass filter. The device 31 is an image adder and the device 32 is an image com- 
parator. Therefore the output 37 of the image adder 31 becomes the two-dimensional 
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^^At^^ 0 ^ 3nd «** Po«i°n in excess 
very taTdeliS s^SXVl t electt ™Phalograph y which handle 

5 but in the floating'leSd'sy^ taSrtSXSifB 1 -* ^ pr ° blem > 

to the slow drift so that the orobkm of S k t f es ° old le * el ■ varied in response 
verted into the binary Vj^Tta^^n mt 5600118 * hen are con- 

a bad spot may be easily detected 3 Vay ^ P Mk which 

represents 

tmty of the camera tube If a conventional S^Hi. of 1116 noi >-umform sensi- 
representing the nomS black feSrfSS k ? reShold ^J 80 * 1 is ^ the signal 
15 level, thereby nSgly iS^S^JtSf^ t6 ? ds t0 ««» the threshold 

20 Two-Dimension Buffer Memory 

as thecal, I^^SSiSrS^S^i "W 1 Wom ^ -ch 20 
as "the pattern informadon") S *e tCJ? *V* re - feired 10 ^ 
scanning and then rearranging "faV? Cw^EKj p 0 ^™ 011 k by 

*J«£S? SS' 0 ^^ * 8 

A tremendous 5 amount oTvidS £mS , S phshed by 8 com -™- 
and is processed in order m derive T rLrf.t^ ° n r a t core or d ™i memory, 
when a'picture frame divide fby 2^0 SKTSSVift. ° b fe F ° r exam ^ 
320 lines in the lateral direction II „w m *e joogttndaial direction and by 
bits are used to repSenTS briSTa^T * 7<yW0 , picturc eIements - « sk 
memory capable of «or^ 46?Mo bij a^eoSL^ dements ' 8 Rapacity 
must be processed. If it takes 100 S^ !^ Furthermore each picture element 
it would 4e about 77 s^ m oroS^nf S ° dS to P , rocess P 1 ^ element, 
stored in the memory ^^^^^SSZ^TT'- ^ 46 
capacity electronic computer musTbe med for ™c-T long means that a large- 
inspection equipment becomes Try WgL considerable time. Thus the cost of the 

and L^SM ffiiSnt^t. 8 " M * 8 ' 40 

soon as it is received. Thus SreTth ad^taL ri£ a """d* 8 * 1 ? Processed » 
be processed at a speed equal to the input ' PattCm "^tion may 

tanA recSg^ XSoSo^ which is of simul- 

ate denied for £££ £ Sn^TteS^S **» signals 45 

dimension buffer memory shown hL ti twS,^^ 80 ob,ect ^ the two- 
scanning into the one-dimensi^ tmie L^S raS1 ^ ^ ace is "WW* by 
two-dimensional information by S TaiS^Tl ^ "Averted into the 
may be processed in a manner ^b^ adan Jdfo^"^ "V*" ^ video formation 

. In video infonnatSToSng S JtaTV" 50 
an image of the type shown S 6 F S; ( * . rem ° Ve the noise from 
a very simple method for rem^Ke J* ^ P ro P osed 

by using a time filter. HowevertiL * agnals ° btained * scanning 

ponents orthogonal to me s^Tlines p^^f ^ System 80 *" the corn- 
to process thl two-dime^S^o^atioT thl jStT 0 co ^ derati ^ order 
vious scannings must be stored soA^h^J? mfonnat ion obtained by the pre- 
cessed. In practice at lea£ the Lfornfatfon ISkT** may ** also 
preferably stored in the processiS £S J^.* by J* ^ 39 in Figure 6 is 
store an 0 f the informatSn SS SKTdJ^^J^ S ° Iuti ^ is ro 
at 39 may be used at any time ThT it 11 the required mforraation encircled 
the manner described ZSo^^^S^^ » ^ computer fa 
required and a considerable time! SiSSTSSJ T?" °i- St ° rage elements is 
cessmg equipment hemes compl. JSUa^^ ^ 
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if only the information encircled by the area 39 in Figure 6 is stored and processed 
the number of storage elements may be reduced. Furthermore the information is 
processed as soon as the video information obtained by scanning is received so that 
the processing time may be considerably reduced. Thus the device may be con- 
5 strutted quite simply and may process the two-dimensional information at a tugn 

SPCed Thus, when the encircled information area 39 has m scanning lines each having 
a length /, the information corresponding to mXl is to be processed. If the mXl 
portion is capable of acting as a store, the storage capacity is such that only the 

10 information on (;«-l) scanning lines need be stored, not on m scanning lines, lne 

equipment would be very complex in construction and expensive if the storage ele- 
ments used for storing the information along the scanning line / is such that the 
continuously changing brightness information may be stored. Therefore a practical 
method is to divide the scanning line at a suitable interval depending upon the spac- 

15 ins between the adjacent scanning lines (in practice the scanning line I being samp ed 

in time) and to quantize the sampled information for storage. If the scanning line / is 
divided into n segments and a number of * bits is used for quantization, the storage 
capacity for storing the information 39 will become mXnXk bits. The quantized 
information may be stored by registers, delay lines or shift circuits using bubble 

20 memories. .... , . . , T L a ;_,„„„ 

-Figure 7 shows one embodiment in which m-i, n=4 and k-2. ine image 
input device such as a vidicon 12 is used in order to convert the optical image into 
the electric signals. A control signal generator 40 generates the sync signals and scan- 
ning signals to the image input unit 12 and to the sampling unit 13. In response 

25 to the scanning signal the video input unit 12 scans horizontally scanning m a manner 

well known in the art so that the two-dimensional dark and bright image may be 
converted into the one-dimensional electric information representing dark and bright 

raf0r The "electric information is sampled by the sampling circuit 13 in rfponse to 

30 the control signal which is applied from the control signal generator 40 made in 

^nchronism with the scanning signal Therefore the scanning lme I is divided into 

» segments. A quantization circuit such as AD converter 14 converts the aiialogue 

electric information into digital information in response to the sync signal apphed 

from the control signal generator 40 in synchronism with the sampling period. Digital ^ 

35 information derived from the quantization circuit consists of * bits. 

Shift registers 41 and 41' are adapted to store the quantized information on 

each scanninghne and shift their contents toward the output in response to the sync 

signal applied from the control signal generator 40 in synchronism with the sampling 

frequency. Each shift register comprises nXk bit memory elements, and the output 

signal consisting of k bits is applied to the register 41 to the register 41 . 

A shift register 42 consisting of mXnXk bit memory elements stores the 

encircled information 39, and any bit may be written into and read out from the shift 

register 42. The output of the quantization unit 14 is apphed to the input terainafc 

(k tenninals) of the lowermost stage of the shift register 42, the output of the shift 

register 41 to the input terminals of the middle stage, and the output of the shift 

register 41' to the input terminals of the uppermost stage. All of the above outputs 

are apphed in response to the sync signal from the control signal generator 40 in 

synchronism with the sampling frequency. Furthermore in response to the sync signal 

the A-bit signal in each stage is shifted to the right. The bit information stored in 

50 the shift register 42 is applied to the processing circuit 16 for processing the bit 

information. The output of the processing circuit 16 may be apphed to another devu* 

or may be written into the shift register 42. The information processing by the circuit 

16 is also effected in response to the sync signal applied from the control signal 

generator 40. , . 55 

55 The image is scanned from left to right as in the case of the scanning used in 

the television so that when the right bottom corner of the encircled information area 
39 is scanned, all of the information area 39 is stored in the shift register 42. lne 
circuit 16 processing the information stored in the shift register 42 is coupled to 
other circuit the nature of which depend upon the objects of the data processing, 
60 but these are not within the scope of the present invention and no further description 

is necessary. . , . . . ... 

As the scanning and sampling operations proceed, the contents in the snitt 
registers 41, 41' and 42 are shifted. That is the information corresponding to one 
shift is stored in the shift register 42, and the output entirely different from the 6J 
65 above information is derived from the processing circuit 16. As the image is scanned, 
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to store the analogue signals and in^aH .vfT? v • B ? fl 43 are used in order c 
circuits 44, 44' Sd 4TwS? fSIS ^ mplu,S dtadt Figure 7 sampling 5 
from the 'control signal 2£5 f* ^ appS 

quantization circuit 14 shown ffa FfcL^ C*" 1 ?^*«noie instead of the 
10 45" which are also actuated^ resS^T J,^* ^tization circuits 45, 45' and 

signal generator 40 are^ided 11? JZS*?™ ^.mm from the conS 10 
*> described with SUE? F&Tt tSW 1 ^ "J**"*^ similar to 10 
here. 10 rigure 7, so that no further description is required 

shift registers 41 and il'lTSSdX "TO, 42, The "P"* *> the 15 
turn are controlled by me « ^SfffcJf 46 which in 15 

in svnchronism with the SSJg%3t fa ^res^LT* 1 P?^ 40 
assumed that 7=3 and mfnrmatiJL !ST * TO P^sem: embodiment it may be 

register 42. iVrespoS SffSSfi *&SP*1 *» * ^ *» *• *« 
*e control signal P generamr " ?Sl£ MS *5 **" l 80 * 1 is from 20 

the output of Ae circuit 14 lo tta fdff5rit?li 4 - 50 ^ * e * te applying 
flying the output of the shttregiS ffSfc f £K£ * e 
and similar the rate for anS»A^.^i. the uiput terminal thereof is closed 
terminal of the shift rSsS 4^ is ™TI. af ^ 41 to tte input 

of the shift register ^T^^^^J^ apply£g f 4S 25 
m response to the scanning of the semnH on ^ ciosexL. On the other hand, 

the gates 46 and 46'TSIt mel^aSwiJ^^ °? ^ fe a PP Ued » 
mput terminal of the shift reristerfl is dSK!* 6 °S? Ut of J* 6 M to the 
put of me shift register 4?Kie ta«hS*£ff 46 "* 

the gate for applying the outout of th^Mt^- _ er f? f ls pP 0 ^ ami sunflarly 30 
the shift registo 4T * ^oSwnerealAe^^f 1 ' 0 ' J 1 - t0 ? e input terminaI <* 
register 41' to the inptt IStaflSj V*!? J*? ° f ^ 
the shift registers 41 and 41' ^-r ls J °P^ ed - 111 other words the contents in 

35 are malTSAt me four^tl? — ^ 

reference to the first scanning S ^dTKe nSKT < S5 b v ab °T e 35 
put signal of the circuit 14 if arolS I ^ • described above the out- 
is transferred into the sMft refill? ten J??i 4 ^ "i"?* of whicn 
every third scanning line is stored ? tne drift re2£- 4^ SS*^**^ J" 

w information may be nroces-ied in * register 4Z. In this manner the video 

with reference t I'S^dime^t^ffi ^ " *" « 
gate A 47, tSfeWA^K 6 "* " "* 30 ^ 

45 the posing ISt, £ frem Se°Sr?° n ^ a /™^ ^ * 

s ng device 16 may be skipped Ko^ in fjw B ,f .£* *? P"^ 45 

signal applied to the procSing devicTie frerTrhi ™L? ■ ^ ° f the ^ 
be increased accordingly. This arranaL^t 7^ control signal generator must 
different sets of mfoStion ^SESdfa fJFS?"* ^tageous when two 

50 formation processing cm bTaSSSS ! JIw A P roCCS8 ^ dCTlce 16 311(1 ^ i 11 - 
ing circuit 13. completed within the sampling period of the sampl- 



20 



25 



30 



Small Portion Extracting Device 
1. Boundary Space Method: 



55 bright ta'ern 2 gSSlly S£s fetS 1 ^^--nal dark and 

bright areas. The bad spoTofdefec^Tn £ £* . h ^ betWeen &e dark ^ 
50 and 51 resuectivrfv vT u ■ dark ^ hri ^ tlt areas are indicated bv 

is sailed ^anti^Tthe 3 bta^ m 12 which 

to those 50 and q 51 S TindicSed bT? J 7„H ^ ** ^ T 0 * which correspond 
60 boundaries have a proTection 52 and a ™ « res P. e ^ Vdy - / l 18 seen ^t the 

jfrss 5°i wsr^ ? 2-3^^-=*?- r A 
-wn in Atji satac ssrs &a«srti 
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projection or recess at the boundary so that only the bad spots may be extracted 

W ^xtfreferring to Figure 14 the principle of the method for extracting the 
micro spoc which may be the bad spots or projections or recesses at the boundary 

5 7te described. The method for extracting a micro-spot off the boundary is 

to extract the picture elements whose brightness changes from bright dark and 
bright or dark, bright and dark in one direction of the picture elements. For ex- 
am!" Se bad spo* 50' and 51' may be detected because the brightness changes 
&£ bright, dark and bright and dark, bright and dark along the horizontal lines 

10 5™nd 55 respectively. However there is the possibility that a horizontally elongated 
nticrtspot or bad spot may not be detected so that it shouW be monitored in the 
vertical direction and if required in an oblique direction. Therefore any bad spot 
may be detected with a required degree of accuracy m practice. 

As for the extraction of the projections or recesses at the boundaries, two 

15 micro-regions are selected in such a manner that each picture element may be 
interposed therebetween. If one of the micro-regions is dark or bright .when _ the 
other micro-region is bright or dark, then the projecuons or recesses at the bound- 
aries may be identified. For example the projection 52 at, the boundary is ui ex- 
posed between two micro-regions 56 and 56', and the micro-region 56 «s bright 

20 whereas the micro-region 56' is dark so that the projection 52 nwy beidfnafied. 

Similarly the recess 53 is interposed between two micro-regions 57 and 57 , ana 
the former is dark whereas the latter is bright. When the miao-spots extracted In 
the manners described above are compared with each other, the bad spots 50 and 
51" may be distinguished from the projection and recess at the boundaries as 

25 sh0W A p r SL l Lice based upon this boundary space method will be explained 
with reference to Figure 16 which illustrates in block diagram of the equipment 
shown in Figure 1 and provided with the processing device. The optical image 
of Tpart 11 such as a printed circuit to be inspected is converted into elecmcal 
30 video signals by the photo-electric converter 12. A block 59 in the diagram indi- 
cates thebinary conversion circuit 14, the sampling circuit 13, and a device 15 
for extracting "the two-dimensional micro-spot video information from the ^con- 
tinuous video signal 58. The equipment further comprises a circuit 61 fw extract- 
ing the micro-spots from the pattern based upon the above described boundary 
35 space method and a circuit for extracting the boundaries of the pattern Instead 35 
of the device 61, a device based upon the enlargement-reduction or boundary 
averaging method to be described hereinafter may also be used. . 

The micro-spot or local video signal 60 is applied to both the micro-spot 
extracting circuit 61 and the boundary extracting circuit 62, and the output signals 
63 and 64 of the circuits 61 and 62 are applied to the comparator 65 so that lis 
output sipal 66 mav indicate only a true bad spot This is displayed by a bad 
spot display device 67 such as a monitor TV If required not only the bad spots 
but also the background may be display^ in different colours as shown m Figure 
15 so that the position, sizes, types and the like of a bad soot may be more apparent. 

One example of the small portion extracting circuit 61 is shown in figure 
17 Some examples of the portions of the image consisting of 5x5 picture elements 
are shown in Figure 18, and any micro-spot consisting of one or two picture ele- 
ments is to be detected and extracted. In Figure 18, reftren.ee numeral 75 designates 
a logic pattern for detecting and extracatrj a tdcro-spo': the vertical direction, 
76 and 77, those used in the horizontal diction, and i% 79 a«a 80 and 81, those 
used in the diagonal directions. 

The circuit 61 is shown in Figure 17 in conjunction with the logic patterns 
74 and 75, and the output 70s becomes "1" when diere is a micro-spot consisting 
of one or two picture elements in the vertical direction. 68* 680, 68c and &8d are 
« AND circuits, and the inverted inputs are applied to the input terminals with the 55 
symbol o. 69 is an OR circuit. The circuit shown in Figure IV is so arranged that 
its output 70a is "1" when the centre picture element 71 Is 1 and both the 
picture elements 72 and 73 are "0" or when the centre picture eiement 71 is O 
and both the picture elements 72 and 73 are "1". Similarly from die logic circuits 
60 arranged for the logic patterns 76 to 81 shown in Figure 13 are derived the out- 60 
puts 70i, 70c and 70i which are all "1". Consequently, when die picture element 
71 is one of two adjacent picture elements or a single picture clement, the UK 
circuit 63 gives the output "1". . . 

One example of the circuit 62 for extracting the boundaries of the pattern is 
65 illustrated in Figure 19 and the logic patterns to be handled by the arcuit 61 includ- 65 
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ing gates 201 to 208 shown in Figure 19 are illustrated in w m „» ->n n, . • .u 

demons I i the micro-regions 82 and SJ ore all "0" and "1" or^l" J -iKf 
. P nTno 5 'doto P, ?r nSre" J' h ide ? d , e 3 ' S « *< blda? h£ 

gar * *A2tffi at to r.-JiSss 

2. Enlargement-Reduction Method: 

For the sake of explanation it is acsumed that tie oart 11 to he incnp^ /-.?• 

Similarly when the art-a «n» ;* j ^ «*^uucu m ine area l disappears, 

relatively" mo-dimensionaS' me 
of the enlargement and reductio? meSTth* T 
i* ongmal conbguration and position but the ifi £ 4' 5 «?» JSBtt 

mirfl^^feprSed^I^? «-»*nart»I pattern including a very 

not including ^ t S^ ^jSSTSTtSSl^ * ^ ^ 
various purposes. The imaee nf I nrfm-T'- • rest ° red pattern may be used for 

signals, -^^ ^^^tTS^^T^ T ^ e,CCtticaI 
image again to remove defects ae5criDea above -m then converted mto an optical 

the sstrris ^ ^ ■> 

Referring to Figuie 22 AeSef described m more detail hereinafter. 

"0". The area ^bttt^SV^f^*** whitt «» 
includes a small area «r hSd byl? Y 6 WhereaS *"* "°" 

distant that thtpLn S^VStS^ the area "0»by the same 
process, the area 96 £ rontrartedand dta—*^ 22 By the above 

Next the area "1" in thpTL nn ^ Ppears whereas area "1" is enlarged 
by the ^te'^rS! 2A» ® boundary is reduced 
is obtained. It is seen that me area <£°^ T 7L 80 P attern 91 

is restored. In other words, the sZu X VSSrA bUt te "V" 1 «« » 
ss shown in the pattern 91 included in the area "1" is eliminated 

tbat of lb, defees „ m «„» So SJ n££ P"""" 1 ""^P""^ » 
r B ewarged or expanded, a pattern 94 is obtained. It 



25 ments "1 
dements 



10 1,417,721 1L. 

h seen that the relatively small area 

89 are all detected and extracted. It should be noted t^titearea 1 being rcoucea 

and thfn eS bound^m theatrical d g^ A ^£££ 

cessed has the hatched, picture elemetfs 1 g^, d5r original 15 

" S twS'SS'.'Si far dtatadng a mfcrvspo. b, .he cntage- 

be referred to as "film or films" hereinafter) and an unexposed film is over- 
50 3d noon an Ssed and processed film and exposed by the light Mta 50 
Se baTofthe processed film. It is assumed that the processed film has a pattern 
consSgtdarfand bright areas so that when Je film «^ff»SSSi 
nrnr J KP A the dark and br eht areas are reversed. (This process wiu oe reierreu w 
° ESl JSS!^ taSStar in this specification). In some cases, a processed 
as reversal processing film are expanded in all directions by the same 55 

B (This proces ; will be referred 

t Ta? «ex P anS reversal processing" hereinafter in this specification). An unexposd 
%m is S wocSsed that even a small area which has been exposed by the light trans- 
mSed XrSSfJte Ifeta area of the original film even for a very short time may be- 
60 Wa dSXwTsS ariVan area which has not exposed at all is processed to rep- 60 
St a bririiYTrea [ m above-desaibed conditions may be easily satisfied when high 
rnmrast filnts (which are readily available in the market) are used. 

Nexf re eS to Figures 24 and 25 the image forming process will be desenbed 
in moTdSauTeremafteTAn original image or pattern on a film has dark area 
65 show? hatched) and bright areas. The large dark area includes a bnght micro-spot 65 
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118 in P the dk ai^s £Sd ° f ' pattem 107 ' 311(1 «* 

118 may Sansmit ie ffso £t ir £niT d 5? i 10 ' 0n i y bri S ht ™cro-spot 

of the pattern 114, a MttoTnS! U « eliminated. By the reversal processing 
25 origfa/image 107 * K "mp^L? ^ " ^ ^ dark ■« * * 

which the dark area fa ttaXiii? ;fl^ ' a P"* 01 116 is Gained fa 
114 is substantial^^ lTSf* " """P 4 SinCe * P attem 

3S and £?SOT6 1 W!^*^te , t ST? ^ f^** OT 

micro-spot 117 is eliminated I 7 to ° ngmaI 107 aax P t ** *e dark 3f 

enlarging or expanding tte da?k aS mSS^L -"f^" 8 °f com P ress ^g and then 
« or ending and the? SuS Kfi^TSPJS ^ ° f r 
spot ?7%T^?Jl;^ {ff ^ *e dark micro- * 
to each other, only the LSoWt W^nSfTv l° 8 ^ 116 *** 
extracted. Alternatively ■ JS3FU2 D ?l^^ii« ht 80 * be easily 
45 all of the micro-spots 117 and 118 2L fciS " 6 f e re 8»tered to each other, 

detected and extracted d " the 0ngmal P attem 107 ma y be readily 4: 

proc^gtf^^'K 'and^S * ° tatad by fc «P™ reversal 
112, a pfttem 113bAiifid ?wtt?K° D ? wnaI processin S of * e P a «<™ 
50 fa the original 107 a«Sjed ifi ?j£$L? T** U l md 118 ^uded 

similar to^e original patT^ ^J^SS^S^^ 50 

111 the process for obtaining the rat e-n m E^aT • ■ ? P ?^; , 

amount or first r^HnreH k« o A ^ / 111111 111611 reaucea by the same 
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comparison of an original pattern with the pattern proved by one : or -bo* of the 
above methods any micro-spot included in the original pattern may be extracted. 

In genenl defects or noise components included in a pattern ^are very mmute 
sd that thev may be readily extracted by the processes described above. 
= The above processes do not require" the registration required in general in ffic 

5 pattern recognition system. That is to say, there is no need to determine a correct 
feS Son between a reference pattern which has been previously stored and 
S hpnt SJ of a pattern to be recognized or inspected. Such registration ^can , be 
Stremely difficult because a pattern to be recognized or inspected might not com- 
,„ pSely coinc de in detail with a reference pattern: this would follow from the fact 
10 CL part to be inspected would have various defects. Therefore the processes des- 
cribed ar^ simple in their application to the inspection of pruned circuity 
S or printedTaraaers. In a conventional system in which the registration is required, 
it is ex Sy difficult to detect and extract the defects or deformauons unless a 
co^cfrS^ce pattern is stored, but the processes described do not require : the 15 
S of a referee pattern so that the use of a storage device may be eliminated 
Furffiermore any new pattern which has been hitherto never processed may be equally 
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In tie processes described above, the amount of enlargement or reduction deter- 
mines the sL of a micro-spot or defect to be detected. Therefore the P« e " 20 
S for the purpose of detecting a relatively large micro-spot or defect in a large 
mSrn shouU not be used for detecting a relatively small micro-spot defect m 
fsmall pattern. Such inspection conditions would generally be laid down in detail 

* VSESfZvSSr*. a large number of storage elements are arrayed 25 
? s shown at 119 and 120 fn opposed relation with the space of an image. Any storage 
*X be used as far as' ^formation may be written ffito and read ou from J, 
and in this embodiment flip-flops are used. In the arrays 119 and 120, jach i square 
defined by the broken lines represents a picture element in opposed relation with 
which is disposed each flip-flop or storage element 30 

E^ch ffip-flop in the array 119 is turned on «1» or off "0" depending upor .the 
corresponding picture element being bright or dark. For example when the image m- 
PuV dlvice 12 is a television camera of the type scanning an object horizontally from 
Se upper left to the lower right, the output signals from the quannzing circuit 14 
are sequentially stored in the flip-flops in the array 119 from the upper left on to 
the lower right one. The above arrangement is well known m the art so that the lurtbcr 

^ife ^1^712? which is substantially similar to the flip-flop array 119 
serves to store the information to be processed in a manner now to be described. As 
shown in Figure 26 3 each flip-flop in the arrays 119 and 120 is identified by the 
coordinates (:,;^ enlargement process described hereinbefore. The 

contend in tfe five flip-flops (i-l,/)> ftj-l), (4 A fti+D fl a ? n d fl ( ' + t 
array 119 are applied to the OR gate 121. The output of the flip-flop (i,f) in the 
S 120 is also applied to the OR gate 121. Similarly, such an OR gate is provided 
for every t and ;. (For example when i=l, 2, . . . , m and ;=1, 2, . . . n, me 
total of »*X* OR gates are provided. The number of inputs to teORgje^g 
than five when i and ; approach / or m or n). Therefore the enlarged 1 is applied 
to the flip-flop array 120 from the flip-flop array 119. 

For example when information is stored as shown m Figure 27 m the flip-flop 50 
array 119 (the hatched square represents the flip-flop state «l" whereas the white 
square, the flip-flop state "0"), information is stored in the flip-flop array 120 as 
shown at 123 in Figure 27. This means that the hatched areas are enlarged or ex- 
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« The method for storing in the flip-flop array 120 the reduced area information 55 

of the flip-flop array 119 may be accomplished by using AND gate instead I of the 
OR gates 121 shown in, Figure 27. That is, the information stored m the flip-flop 
array 119 as shown at 123 in Figure 27 may be stored in the flip-flop array -120 
as shown at 124 in Figure 27. This means that the hatched areas shown at 123 in 

fin Figure 27 are reduced as shown at 124. , , , ® 

The hatched areas shown at 122 are enlarged as shown at 123 and are reduced 
as shown at 124. It is seen that the small white area included in the main hatchea 
area shown at 122 disappears in the pattern shown at 123, as is reqwed. 

The process is made in two steps in the manner described above so that the 

65 equipment may comprise in practice, firstly, means for storing the video information, 65 
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The output of Or-ateneS mT,ZT' **S~. 132 and 132 '« 

* d^^rf^^W^ 5« storage 

45 the storage elements which are «1» in the stoST «Sfw ? Action of 

which are "1" in the storage 7 e 127, ^ StOKge elements 

which are A''\tL ^S e tl^cl L^ enlargement of the storage elements 
the large "area 1" hf tKraJ devi 1 77^°- 6 ^ . smaU Karea " deluded in 
The i W «?' tclS^ d S1arf 

elumnated in the stora^ <w.v* iaT7 ml ^ , . m 1116 stora g e device 127 is 

127 is derived as "the area" "1". Similarly to TsmaU ^W' «1» T™ g l 
"area" "0" in the storage device 127 federivedTs die W» °2S?* m ^V*- 8 " 
OR outputs are derived from rh^ mnt l,; V !? me a 5 ea . 1 wfcen * e exclusive 
the OR outpute are deriv^fm^ f l J? J 1 * devices 127 311(1 131'. When 

also for the sake of simplicity 7 ^ descnbed above are not shown 

65 Each square of the storage devices 127, 129, 131, 129', 131' and 134 represents 
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SSS^S"^ ° f P R S ate . meaos «* of which is coupled to a plurality of 
predetermined storage elements in said video information storage meaVXhv 

storage elements m said OR gate output storage means thereby eivine the AND n,t 

for storing the AND outputs of said plurality of AND sate mean, ThJ r 8 l„73 
the third and fifth means are UlustratecUt 123 £d 124 if BtaSS 

When the second and fourth means are exchanged, the hatched ™, ™ m 
KZ?#l ^'^^f 1 - The State of «* fifTmeSs imulrSSat 126 m 

gates. Then the output "1" of the EXCLUSIVP r r>R «V» ' EXCLUSIVE OR 

information stored in the storage device 129 is m£m<-«m£ .« axtt 8 ^ • 
similar in construction and opStion m a ptea% oIInD S^dbJP-wf " 

elements Kft2j3£ S^^SS^ STSS^PS 
132' are similar m construction and ooerari™ m .Win UTV,. 13 ?,', 131 , ™* 
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iai/ • m . 6V " x^/ ana 131. Networks 128' 129' 1W ia.v o^i 

132' are similar in construction and operation to those 130 129 iia i A .i 35 
respectivelv An OR rat-p npwi, • >j , . ' 1Z8 > I 31 and 132 
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a storage dement for each picture element and stores "1" or "0" depending upon 
whether the corresponding picture element is bright or dark. Reference numerals 
128, 130' and 133 designate the OR gate networks; 130 and 128', the AND gate net- 
works; and 132 and 132', the EXCLUSIVE OR gate networks. Each EXCLUSIVE 

5 OR gate may be provided from two AND (NAND) gates 136 and 136' and an OR 5 

gate 137 connected as shown in Figure 29B. 

In the embodiment described here the centre picture element as well as four 
adjacent picture elements are processed, but it will be understood that the number 
of picture elements to be processed is not limited to five. When a bad spot or micro- 

10 spot to be processed is larger than a picture element, the number of picture elements 10 

to be processed must be increased accordingly. Furthermore in order to overcome 
the problem of directions of the enlargement and reduction, it is preferable to handle 
all of the picture elements included in a circle whose centre coincides with the centre 
picture element When a pattern except a bad spot consists of a horizontally or vertic- 

15 ally extending areas, it is preferable to handle or process a cross-shaped picture 15 

element as a centre element, that is a centre picture element extended in the vertical 
and horizontal directions. 

In some cases it is more efficient to process the picture elements in step than to 
process all of the picture elements simultaneously. For example, instead of enlarging 

20 in both the vertical and horizontal directions by one picture element in the manner 20 

described with reference to Figure 26, the centre picture element may be enlarged only 
in the vertical or horizontal direction by one picture element. In this case, the similar 
result may be attained. The process described with reference to Figure 23 is this 
method. When the process is accomplished in step, the processing time is increased, but 

25 the processing equipment becomes simple in construction. 25 

Next referring to Figure 30, an equipment for accomplishing the optical proces- 
sing methods described hereinbefore with reference to Figures 24 and 25 will be 
described. It will again be appreciated that the following description with reference 
to Fig. 30 and Figs. 24 and 25 does not form any part of the invention claimed and 

30 is only included to assist in the understanding thereof. In practice a condenser lens 30 

(not shown) is interposed between a light source 138 and an original film 139 in 
order to provide the uniform illumination. An unexposed film 140 is placed upon a 
frame 143. The original film 139 corresponds to the original pattern 107 in Figures 
24 and 25 whereas the unexposed film 140 is used to obtain the pattern 108. When 

35 the pattern 108 shown in Figures 24 and 25 is used as the original film 139, the 35 

unexposed film 140 is used to obtain the pattern 108. The image on the original film 
139 is focussed at the same size through a projection lens 141 upon the unexposed 
film 140 placed on the frame 143. The original film 139 is placed upon a frame 
142 which in turn is slidably placed on a frame 144 which in turn is placed upon 

40 a frame 145 for slidable movement in the longitudinal direction. The positions of the 40 

light source 138, the frame 145 and the lens 141 are fixed. 

An operating lever 146 whose one end is fixed to the frame 142 has an aperture 
147 through which extends a pin (not shown) extending from the frame 145 so that 
the movement of the frame 142 by the operating lever 146 is limited by the engage- 

45 ment of the pin with the aperture 147. Furthermore the rotation of the frame 142 is 45 

prevented. 

Next the mode of operation will be described. First the light source 138 must be 
turned off and the operating lever 146 is adjusted so that the pin is located at the 
centre of the aperture. The holder 143 is adjusted so that the image of the original 

50 film 139 may be focussed through the projection lens 141 upon the unexposed film 50 

140. Next the lamp 138 is turned on and the operating lever 146 is actuated in such 
a manner that the pin is run around the edge of the aperture 147. Thereafter the 
lamp 138 is turned off and the exposed film 140 is processed. Thus the expanded and 
reversed image is obtained. When it is desired to obtain a reversal image, the operat- 

55 ing lever 146 must be maintained stationary. 5 * 

The above exposure process must be made in the dark room. It is preferable to 
use a high contrast film such as a film used for preparing a printing plate. The aper- 
ture 147 in the operating lever 146 must be determined depending upon the enlarge- 
ment or reduction amount or scale and of course upon the size of the pin. In general 

60 the aperture is circular in order to eliminate the problem of the direction of the en- 60 

largement or reduction, but in some cases an aperture may have a special configura- 
tion depending upon die purpose. The position of the holder 143 must be correctly 
determined because it in turn determines the distance between the original film 139 
and the unexposed film 140 and also the accuracy in registration between two pro- 

65 cessed films when they are registered with each other in order to extract a micro-spot 65 
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in the manner described with reference to Figure 24 with the two patterns 110 and 
107. It is therefore preferable that the holder 143 is located in a predetermined posi- 
tion in the equipment 

The equipment of the type described above may be used for example for cor- 

5 recting a pattern haying a micro-spot or bad spot A pattern which is used for manu- 5 
facture of printed circuits or the like and which has bad spots or defects caused in 
drawing the pattern may be corrected by this equipment Furthermore an original 
film used for printing a number of copies may be also corrected by this equipment so 
that the original film may have no defect or flaw. The equipment can also be used 

10 to provide a pattern only showing the bad spots. 10 
When die printed circuits which are manufactured with a pattern having a sharp 
angle are inspected by the equipment of the present invention, a portion having a 
sharp angle may be detected as a defect or bad spot However when the original 
pattern used in the inspection is corrected in the manner described above, the portion 

15 haying a sharp angle may be eliminated so that this portion may be prevented from 15 
being mistakingly extracted as a bad spot Therefore the equipment may be used 
for preparing a reference pattern best adapted for use with the micro-spot inspec- 
tion equipment in accordance with the present invention. It is of course understood 
that a reference pattern in which a sharp angle portion included in an original pat- 

20 tern will not adversely affect the result of the inspection of the parts manufactured 
from the original pattern. 

As described hereinbefore an area in one binary state in a two-dimensional binary 
pattern is enlarged or reduced in the two-dimensional space and then reduced or 
enlarged so that the micro-spots or bad spots included in the pattern may be elimin- 

25 ated. 

By comparing the original pattern with a pattern obtained by one or both of 
the methods described above, only the micro-spots or bad spots included in the 
original pattern may be detected and extracted. In enlargement and reduction the 
boundary line is preferably enlarged or expanded and reduced or compressed in the 
30 direction perpendicular to the boundary line, but the present invention is not limited 30 
to this method alone. 

The eliminated or extracted micro-spot or bad spot is very closely related with 
the expansion and compression of the boundary line. The higher the degree of expan- 
sion or reduction, the larger the size of the eliminated or extracted micro-spot or bad 
35 spot becomes. 35 
Therefore when it is desired to eliminate or extract a micro-spot or bad spot 
according to the present invention, it is preferable that the pattern (which must be the 
correct pattern having no defect or flaw) is larger in size than a bad spot When 
the sizes of the original pattern and the defect are different, only the defect may be 
40 eliminated or extracted without adversely affecting the original pattern by suitably 40 
selecting the displacement of the boundary line in expansion or reduction. 

Even if the above conditions are not fully satisfied, a bad spot or defect may be 
partly eliminated or extracted and when the same process is cycled, the bad spot or 
defect may be completely eliminated or extracted. Therefore there is no problem in 
45 practice. For example a bad spot included in a printed circuit is generally smaller 45 
in size than the conductor and non-conductor patterns. When a relatively large defect 
intersects the original pattern such as a conductor pattern, the intersection generally 
has an acute angle so that a gap between the defect and the original pattern tends 
to be detected as a micro-spot or bad spot Therefore a relatively large defect may 
50 be detected from the gap between the defect and the original pattern which is detected 50 
in the manner described above. 

A relatively small spot included in an original pattern may be eliminated or 
extracted so that a complex pattern may be corrected, that is a pattern from which 
the noise components are entirely removed may be provided. Alternatively only the 
55 defects or noise included in a complex pattern may be reproduced as a pattern. 55 
For example a thin portion and an un-printed portion of a character pattern 
may be corrected so that a correct character pattern may be provided for display or 
the like. When the present invention is applied to the pattern or character recogni- 
tion system, the character recognition efficiency may be much enhanced. Furthermore 
only the defects may be extracted and displayed as a measure of correction. 60 



3. Boundary Averaging Method: 

The boundary averaging method for extracting or eliminating a micro-spot 
included in a pattern will initially be described with reference to Figure 31. First 
a central point 149 in a pattern 148 is selected and the area surrounding the central 
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point 149 is investigated. If the surrounding areas w l" or "0" are larger in number 
than the areas "0" or "1", then the central point 149 is determined to have "1" or 
"0" and a new pattern 149' which represents "1" or "0" is generated at the position 
corresponding to the central point 149. The above operation is cycled over the whole 
5 surface of the pattern 148 so that a micro-spot included in the pattern may be elimin- * 
ated. In Figure 31, a two-dimensional sampled pattern or image is illustrated, but 
the boundary averaging method may be also applied to a continuous or sampled 
pattern or image. In case of the continuous image, the area M l" is compared with 
the area "0". In the method illustrated in Figure 31, 13 picture elements surrounding 
10 the central picture element 149 are investigated, but the number of picture elements 
to be investigated may be determined depending upon the size of a micro-spot to 
be detected. In case of the continuous image the threshold level is determined to 
be one half of the area to be investigated. 

A device 150 is so arranged that when the number of inputs "1" or "0" from 
15 the surrounding picture elements is in excess of one half of the surrounding picture 
elements investigated, the device 150 outputs the signal "1" or "0". 

Next the boundary averaging method will be described with reference to a simple 
:ne-dimensional image or pattern. Figure 32A shows a device for generating a pat- 
tern by the parallel processing of a one-dimensional image which is sampled, and 
20 "igure 32B a device for generating a pattern by the sequential processing of a one- 



iimensional image which is sampled. Devices 150/, 150/, 150k ... and 150/> are 
illustrated in detail in Figure 33. A device 150' shown in Figui 
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Figure 32B can also be 

similar to that shown in Figure 33. It is assumed that a picture clement 152 is selec- 
ted to generate a pattern 152'. In this case two adjacent picture elements 151 and 
25 153 are investigated together with the picture element 152, and the outputs are 25 
applied to the input terminals 160, 161 and 162 of the device 150/. If more than 
-WO outputs are applied to the device 150/, a voltage across a resistor R ; is obtained 
such that a gate 164 is opened and an output is produced at an output terminal 163. 
As a result the pattern "1" or "0" is generated at 152'. In the similar manner des- 
3C :ribed above, the patterns 153', 154', ... are generated. 30 
In the device shown in Figure 32B both the original and generated patterns are 
simultaneously shifted in order to generate the patterns only by one device 150'. 

The parallel and sequential or serial processing devices described above with 
reference to Figure 32 may be also applied to a n-dimensional image or pattern 
35 which is sampled, but description of diis is not necessary as the arrangement will be 35 
apparent to those skilled in the art from the above explanation. 

Figure 34 shows a variation of the device for generating a pattern by the parallel 
processing of a one-dimensional image which is sampled. (A) and (F) show an original 
pattern, (B) and (G;, the original pattern shifted to left, (C) and (H), the original 
40 pattern shifted to right, (D) and (I), a pattern formed by the addition of the original 40 
pattern and said patterns shifted to right and left, (E) and (J), a binary-coded pattern 
of the addition pattern, and (K), a pattern generated as a function of the combined 
patterns shown at (F., (Gj, and (H). It is seen that the sum of any three adjacent 
picture elements in A is same as the picture element in (D) which corresponds in 
45 • position to the central picture element of the three adjacent picture elements in (A). 45 
Figure 35 shows a diagram of a circuit for processing serially a one-dimensional 
continuous image. Reference numerals 165 and 166 denote an input and output termi- 
nal respectively, and D t — D„, delay lines. The output of an original pattern is applied 
to the input terminal 165 and thus to the delay lines D, — D n . When the voltage 
50 across a resistor R 3 becomes higher than a predetermined level, a gate 167 is opened 50 
and an output is derived from the output terminal 166 for generating a pattern. 

4. Small Portion Extracting Method 

Opposed to the boundary spacing method, the enlargement-reduction method and 
the boundary averaging method described hereinbefore, the small portion or bad 

55 spot extracting method does not require a boundary extracting circuit. Any of the 55 
micro-spot extracting circuits based upon the above three methods may be used as 
a micro-spot processing equipment, but they tend to detect the projections and notches 
on the boundary lines as defects. Therefore these circuits must be used in combination 
with a boundary extracting circuit of the type described hereinbefore. 

60 However the processing equipment based upon the bad spot extracting method 60 

to be described in detail hereinafter may attain both the functions of the micro-spot 
extracting circuit and the boundary extracting circuit 

Referring back to Figure 13, the hatched areas represent a copper foil on a 
printed circuit or chrominum or emulsion on an IC mask. The bad spots 50 and 
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50 are included in the dark and bright areas. The projection 52 and the notch 53 

are formed at the boundary lines due to the sampling of the pattern. 

tw „ i C T ? uT based r "P° n * e micro-spot extracting method has an advantage 

Sfch 5 ? tt * ba i 8po ? 50 • and 5V extractcd but *e P^on 52 and the 
notch 53 on the boundary lines are not detected and extracted. 

m iSt M tw g t0 / i g ure . 36 > a P ictu « dement 168 is selected and regions 169a 
at th r r ° Und ? 6 dement 168 are investigated. The configuration 

SLw;^ n ? M^Vwfng regions 169a to 169* are selected depending upon the 

?Tn P Sli^° ngmal Pattcrn 10 1)6 in ^ ectcd - Preferabl y the surrounding P «gbn 
! SiJf °f augment. an egg, an ellipse or the like whose elongated portion 

ffiafooSSir dement 168 - has 3 e « 

a nn Jl e fi t ^ meth( ^ ? r feteraaining whether the picture element 168 is a defect or 

I k^ffnev or It 4"T d tha ^ e picture eIement *«* S 

, ?«e ^o ( 1 or 0 The picture element 168 is detected as a Dart of a 
normal pattern when and only when all of the picture elements induded u??t kJt 
one surrounding regl0 n 169 are Po. In other words, when the lo^c £tion 
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§ralwlvs W ri^^» P S^ tT? 168 * I 81,01 or defect ^ ^tion 
tIJaZT & - ■ 1 wh , en £ least one of *e Picture elements included in the sur- 
re ?°? 1 1S n? 0t Po - Therefore ^ ^ Action Go gives «1» when the bad 

the notch 53 on the boundary lines. Therefore from the binary pattern shown in 

E 3 r% mdu ^^ bad spots thc P attera show ° in Kgu^lf m^be dK 
obarned. In Figure 15 the micro-spots 50" and 51" correspond to the had ImW 

12 m * e P a «e™. in Figure 13. If the extracted bad spos and Ae back- 
ground are displayed in different colour on a colour display device, dielLS SaL 
positions and the Kke of the bad spots may be easily detected 5 types ' 

Next an equipment using this micro-spot extracting method will be described 
with reference to a block diagram shown in Figure 37. The optical image of T Srt 

efo?l t?w d f*. 88 a printed or IC ma sk is conv?rtS 5£ electriS 
signal by i photo-electric converter 12 such as a television camera. The S»3 
171 _ from the camera 12 is converted into the binary coded signals 172 by an ^alZe 
to-digital converter 14. A device 15 extracts sequentially the U^taeSoS Wal 
video signal 173 from the binary coded and sampled video signTm A Si ™- 
uon pressing device 174 is adapted to extract ated spot i the local SeoSl 

unit 176. The display unit 176 may be a colour display device for displSg a bad 
g^ n 35 COlOUr ^ rf "f™* *e background from the signal 172 as^own in 
Figure 38 shows some examples of the binary coded and sampled patterns which 

described above. 178 is a central picture element, and 179 to 186 are th* K »u 
ment r^ions which are subjectedSo the space^c procSshS f fjSffi A 
?^^ mV T° n - Since ,. the ^ 18 sampledf the P regionTai? SSS 
figurauon depending upon the directions. The surrounding regions 17!Mol86 m^t 

^ffQ^ 0 ^P^Jy f en«rcle the central picture Sen t 17? 
A Jt,S Sl ^ 0WS u for accomplishing the above logic function (1) An 

AND gate 187 gives the output 188a of "1" when all of four picture Elements h£ 
eluded in the region 179 of the two-dimensional local videc Ts£udl73 
when and only when all of the picture elements b.J^^SJ^SS, 
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179 to 186 are "1", the outputs "1" 188* — 188/r are derived. If all of the picture 
elements in any of the regions 179 to 186 are "1", the output of an OR gate 189 
becomes "1", and if the central picture element 178 is "1" the output of an AND 
gate 191 becomes also "1". Then the central picture element 178 is detected as a 

5 part of a normal pattern so that the output 175 of a NOR gate 183 becomes "0". 5 

Similarly, when the central picture element 178 is "0" and if all of the picture ele- 
ments in any of the surrounding regions 179 to 186 are "0", the output of an AND 
gate 193 becomes "1" so that the output 175 of the NOR gate 192 becomes "0". 
When each of the surrounding regions 179 to 186 includes a picture element opposite 

10 to the central picture element 178, the latter is detected as a part of a bad spot or 10 
defect and the NOR gate 192 gives the output C T\ 

As described hereinbefore according to the present invention the local video 
signals of a dark and bright pattern image are sequentially derived and a true bad 
spot included in the local video signal is detected and extracted. Therefore the pro- 

15 jections or notches on the boundary lines may be prevented from being mistakingly 15 
detected and extracted as a defect, and the bad spots on the printed circuits or IC 
pellets having the complex patterns may be easily detected and extracted. Further- 
more only the bad spots or defects may be displayed on a display device, and an 
alarm device may be actuated when the number of bad spots reaches a predetermined 

20 number. Moreover in response to the signal of the alarm device, a device for con- 20 
tinuously or intermittently feeding parts to be inspected into the micro-spot or bad 
spot inspection equipment may be temporarily stopped, and a part such as a printed 
circuit having a bad spot may be rejected automatically. 

WHAT WE CLAIM IS: — 

25 1. Apparatus for detecting and extracting portions in a pattern including: in- 25 

put means for sequentially scanning a pattern to be inspected and converting said 
pattern into an electrical video signal; means for sampling said video signal at pre- 
determined sampling time intervals corresponding to picture elements of said pattern 
tit be inspected and converting said video signal into binary form; a two-dimension 

30 image extracting means for rearranging the one-dimensionally arranged output from 30 

said sampling and binary converting means into a two-dimensionally arranged signal 
representing a sub area of the pattern; and processing means for extracting a signal 
from the information stored in said two-dimensional image extracting means, to 
thereby extract a small portion from said pattern. 

35 2. Apparatus according to claim 1, wherein said two-dimensional image extract- 35 

ing means comprises: first memory means, in which one element or a plurality of 
elements connected in series, each store the pattern information per one scanning 
line obtained by said sequential scanning and for shifting said stored pattern informa- 
tion in response to the shift of the scanning point of said pattern information which 

40 is made in response to a sync signal in synchronism with a scanning signal, and 40 
second memory means for storing the input information applied to the first element 
in said first memory means and the outputs of all said elements in said first memory 
means and for shifting said stored information in response to said sync signal 

3. Apparatus according to claim 1 or 2, wherein saic} means for converting said 

45 video signal into a binary coded video signal comprises: means for subtracting from 45 

said video signal a predetermined signal level; means for reducing the amplitude of 
the output from said subtracting means and for smoothing the reduced output; means, 
for adding said predetermined signal level to the output of said reducing and smooth- 
ing means; and means for converting said video signal into a binary coded video 

50 signal with the output of said adder means as a threshold 50 

4. Apparatus according to claim 3, wherein said small portion processing means 
comprises: a small portion extracting circuit for providing an output when the 
number of the binary coded signals representing one of the two states of a plurality 
of picture elements included in any of a plurality of continuous patterns passing 

55 through a predetermined picture element in a plurality of directions is less than a 55 

predetermined number; a boundary portion extracting circuit for providing an out- 
put when the binary signals representing the binary states of two local areas which 
are selected in a plurality of directions with an insensitive region, including said 
predetermined picture element being interposed between said two local areas, are 

60 different from each other; and a comparator for receiving the outputs of said small 60 
portion extracting circuit and said boundary portions extracting circuit and for generat- 
ing an output when and only when said boundary extracting circuit does not generate 
an output 

5. Apparatus according to claim 3, wherein said small portion processing means 
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Wa? i?* pTOC ! Ss i ng .? eai,s comprising: means for compressing and then exnand- 
mg the bmary coded video signal in one state; and mean? connected to lid c?m 

S^ZStET* f ° r md *" -pressin n g e ^Vbin?; d cS 

or Fig. 28 or Ti e ST o?V\ZS^ S!.^ ** *' " Fl& 9 ' w ^ 16 > 

MEWBURN ELLIS & CO., 
Chartered Patent Agents, 
70/72 Chancery Lane, 
London, WC2A IAD. 
Agents for the Applicants. 
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